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The paiticle swarm approach provides a low complexity solution to 
the optimization problem among various existing heuristic algorithms. 
Recent advances in the algorithm resulted in improved performance at 
the cost of increased computational complexity, which is undesirable. 
Literature shows that the paiticle swarm optimization algorithm based on 
comprehensive learning provides the best complexity-perfoiinance trade- 
off. We show how to reduce the complexity of this algorithm further, with 
a slight but acceptable performance loss. This enhancement allows the 
application of the algorithm in time critical applications, such as, real- 
time tracking, equalization etc. 

Introduction: The particle swarm optimization (PSO) algorithm was 

introduced in 1995 by Kennedy and Eberhart (T] |2l- It is a population 

based optimization algorithm, emulating swarm behavior that is observed 

in a herd of animals, a flock of birds or a school of fish. For function 

optimization purposes, the swarm consists of particles, hence the name 

f>f-particle swarm optimization. Each particle searches for a potential solution 

|n a multi dimensional search space. The aim of the swarni is to converge 

{"~j :o. an optimum solution, global to the whole swarni. The estimate for each 

^vjparticle is tested using a certain fitness value that defines the goodness of 

the estimate. Every particle combines its own best attained solution with 

iahe best solution of the whole swarm to adapt its search pattern. 

<^^ Several variants have been suggested in the literature to improve the 
erformance of the PSO algorithm. Each variant has its own advantages 
I iiH disadvantages. Among the most popular variants, the comprehensive 
Reaming PSO (CLPSO) and orthogonal learning PSO (OLPSO) algorithms 
provide the best performance over a wide range of test functions (3] 14). 
,_^.esults in |,3J and 14,1 show the superiority of these two algorithms over the 
rrTjther variants. However, both these algorithms are computationally very 
h^complex. In general, the CLPSO variant provides the best performance- 
s-Complexity trade-off among all other existing PSO variants. Still, it is too 
C/yomplex for many applications, such as channel equalization and radar 
CJdetection etc. It also tends to be slow converging as it attempts to provide 
' highly accurate results. We note that most applications do not require 

such a high level of accuracy. Here, we propose a fast converging, low 

^"complexity solution that achieves reasonably good level of accuracy. The 



the particle stops improving for a certain number of iterations then the 
neighbor particles for the sub-vectors are changed. The velocity update 
equation for the CLPSO algorithm is given by |3 1: 



vi {i + 1) =wk{i).vi ii) + ck.Tk. {pi - xi (i)) , 



(2) 



where w^ii) is a time- varying weighting coefficient, pf. gives the overall 
best position value for dimension d of particle k, cj. is the acceleration 
coefficient and rj. is a unifomily distributed random number. The overall 
CLPSO algorithm is thus defined by the following set of equations (3J: 

Vfc (i + 1) =«;fe(i).Vfc (i) + Cfc.rfc. (Pfe - Xfe (i)) (3) 

Xfc (i + 1) =Xfc (i) + Vk{i + l), (4) 



The Accelerated CLPSO Algorithm: An event-triggering approach is 
applied to the CLPSO algorithm. The accelerating coefficient c^ is set to 
if the distance value I p^ — 2^^ (i) I < 7, where 7 is a certain threshold. This 
ensures that the particle stays close to the best obtained vector. However, 
each dimension is to be treated separately and the accelerating coefficient 
Cfe is converted into a vector where each individual value cj? is treated based 
on whether the distance value for that dimension is within the threshold 
or not. Thus, the accelerating coefficient is governed by the following 
equation: 



4 (i) - 



0, if|}3^-a:^{j)|<7 
C otherwise 



(5) 



The above formulation stems from two observations. One observation 
is that all dimensions do not require an update at every iteration. Secondly, 
every iterative step does not contribute significantly towards an improved 
update. The update equations are executed every time, resulting in extra 
computations. Our proposed step aims to remove the insignificant update 
steps, resulting in a faster algorithm. We term our proposed algorithm as 
an accelerated CLPSO algorithm (ACLPSO). 

Test Functions: Several test functions are available in the literature that 
can be used to test the performance of the different variants of the PSO 
algorithms |3. 4|. The algoiithms aim to minimize the fitness value for 
these test functions. Due to the paucity of space, we choose only the five 
functions given in Tabled 



ost is a slight degradation in performance, which is still highly acceptable Table 1: Test functions and their equations, 
'or the aforementioned applications. 



00 

r^~Comprehensive Learning Particle Swarm Optimizer (CLPSO): Consider 

G Z)-dimensional hyperspace in which a swarm of N particles is 

\l trying to find the optimum solution, given by the position vector 



d enoted by the D-dimensional vector Xj. = [a;^ , a; 



The individual position of each particle k is 
, x^l . Similarly, 



K 



ihe velocity vector of each particle k is given by the vector V^ = 

. Each particle updates its position based on its own best 

■ecorded position as well as the best recorded position of the whole swarm. 



K'-i. 



^et the best individual position vector of each particle and the best global 
^H ^ •.• . 1 1 . . 1 .1 . T-» r 1 9 ^^^T 



jrtDtjsition vector be denoted by the vectors P^ = \p\,p\, 



'Pk. 



and 





Function names 


Function equations 


1. 


Sphere 


fi{x)= E a;? 

i=l 


2 


Rosenhrock 


f2(x) = E (W0{x1 - x, + if + (XI - 1)") 


3. 


Rastrigin 


h(x) = E (^? - lOcOS (2TTXi) + 10) 


4. 


Griewank 
Ackley 


/4(:r)=E aio- n^<=°«(^) + i 


5. 


/5(x) = -20cxpUo.2ji E a;^ 






-cxp ( -p- E COS (2-iTXi) j + 20 + e 



[9\g^ 



, respectively. Then the velocity update equation 



for the PSO algoritiim is given by: 

< (» + !) = < ii) + ci-n. [pi - xi (i)) + C2.r2. {g" 



;W), (1) 



where fc = 1 , ■ ■ • , A'' is the particle index, d = 1 , • ■ ■ , D is the dimension 
index, i denotes the time index, ci and C2 are positive constants known 
as the acceleration coefficients, and ri and r2 are uniformly distributed 
random numbers within the range [0, 1]. The global best is generated from 
the neighborhood of each particle. In general, the velocity and the position 
for each particle are bounded within a predefined limit, [—Vmax, Vmax] 
and [Xmint^max], respectively. The bounds ensure that the particles do 
not diverge from the search hyperspace. 

The CLPSO algorithm divides the unknown estimate into sub-vectors 
(3)- For each sub-vector, a particle chooses two random neighbor particles. 
The neighbor particle that gives the best fitness value for that particular 
sub- vector is chosen as an exemplar. The combined result of all sub- vectors 
gives the overall best vector, which is then used to perform the update. If 



Results and Discussion: In this section, we compare the performance 
of the standard CLPSO algorithm with the newly proposed ACLPSO 
algorithm using the test functions defined above. The swann has 40 
particles, with each particle having 30 dimensions. All results are averaged 
over 200 experiments. 

Table|2]gives the results of the simulations. Two different values of 7 are 
chosen for detailed analysis. The table shows the mean fitness values for 
the CLPSO and ACLPSO algorithms when they run for the complete 5000 
iterations. As can be seen from (|3), there are a total of 3 multiplications 
for updating each dimension per particle. The first multiplication occurs 
every time for both the algorithms. The remaining two multiplications 
occur in the proposed algorithm only if the threshold value is exceeded 
whereas they always occur for the CLPSO algorithm. As a result, the 
number of computations is reduced. The %-age computations column lists 
the amount of computations the proposed algoiithm requires relative to 
the standard CLPSO algorithm. The effective iterations column gives the 
equivalent iteration number at which the CLPSO algorithm has the same 
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number of computations as the proposed algorithm. The effective mean 
is the fitness value of the CLPSO algorithm after the number of effective 
iterations. As can be seen, the proposed algorithm provides a very fast and 
low-complexity result for all test functions. The only trade-off is that the 
proposed algorithm does not achieve the same final value as the CLPSO 
algorithm. However, this trade-off is acceptable as the applications that 
require fast convergence, generally, do not require accuracy of more than a 
few decimal places. This is the main focus of our work and, as can be seen 
clearly, the outcome is more than satisfactory. 

Table 2: Simulation results. 



Func. 


1 


CLPSO 

Actual 
Mean 


Mean 


ACLPSO 

%-age 
Comp 


Eff 
Iter 


CLPSO 

Eft- 
Mean 


M^) 


le- 1 
le-3 


7e - 14 
7e - 14 


6e - 2 
6e -6 


43.34% 
67.33% 


2167 
3367 


0.47 
le- 2 


Mx) 


le- 1 
le-3 


28.17 
28.17 


34.24 
28.23 


44.31% 
67.78% 


2216 
3390 


68.56 
29.44 


M^} 


le- 1 
le-3 


2e - 11 
2e - 11 


11.87 
le-3 


43.57% 
67.33% 


2179 
3367 


57.42 
2.79 


Mx) 


le- 1 
le-3 


9e - 15 
9e - 15 


3e -3 
3e-7 


43.24% 
67.29% 


2162 
3365 


2e-2 
6e-4 


Mx) 


le- 1 
le-3 


2e- 7 
2e- 7 


0.28 
2e-3 


43.35% 
67.34% 


2168 
3367 


1.04 
0.10 

















The simulation plots are shown in Figs. [T]and|2]for only two of the 
results. These results corroborate the results in the table and the discussion 
about the results. 




algorithm performs faster than the standard CLPSO algorithm with 
reduced computations and an acceptable degradation in perfonnance. 
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Fig. 1. Performance comparison for Rosenbrock function with 7 = le — 1. 
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Fig. 2. Peiformance comparison for Ackley function with 7 = le — 3. 



Conclusion: We have proposed an accelerated comprehensive leaming 
PSO algorithm that provides a fast and low complexity solution for 
time critical applications. The simulation results show that the proposed 



